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METHOD, APPARATUS AND RECORDING MEDIUM FOR IMAGE PROCESSING 

BACKGROUND OF THE INVENTION 
Field of the Invention 
5 The present invention relates to a method and an 

apparatus for quantifying a sense of contrast of an image 
perceived by a viewer and for carrying out image processing 
on image data based on the sense of contrast having been 
quantified. The present invention also relates to a 
mLO computer-readable recording medium storing a program to cause 
W a computer to execute the image processing method* 

Description of the Related Art 
Reproduction of digital image data obtained by a digital 
m camera or by reading an image recorded on a film as a softcopy 

SJ15 on a display device or a hardcopy such as a print has been 
O carried out. In the case where digital image data are 

reproduced as has been described above, various kinds of image 
processing such as tone processing and frequency processing 
has been carried out on image data so as to cause the quality 
20 of the reproduced image to be as high as that of a print 
generated from a negative film. 

For example, a histogram of image data is generated and 
contrast of an image represented by the image data is found 
by a distribution width of the histogram. By correcting a 
25 tone curve for converting a tone of the image data based on 
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the contrast having been found, the image data are converted 
so that a tone does not become flat or noise becomes 
inconspicuous. Various kinds of such image processing 
methods have been proposed (Japanese Unexamined Patent 
Publication No. 6 ( 1 9 94 ) -253 1 7 6 , for example) . The contrast 
here means a ratio of a dark portion of an image to a light 
portion of the image. Therefore, the contrast of an image 
can be judged by the distribution width of a histogram. If 
the histogram distribution width is wide, the image has sharp 
contrast while the image has weak contrast if the distribution 
width is narrow. For example, an image obtained by 
photographing in fine weather has a wide histogram reflecting 
a dark portion in the shade and a light portion in the sunlight . 
If an image is obtained by photographing in cloudy weather, 
the histogram becomes narrow due to poor distinction between 
the sunlight and shade. 

Another image processing method for quantifying a sense 
of sharpness or graininess of an image perceived by a viewer 
and for changing the content of image processing based on the 
sense of contrast having been quantified in order to generate 
a preferable image has also been proposed ( Japanese Unexamined 
Patent Publication No. 7 ( 1995 ) -1 93766 ) . 

The histogram generated from image data has a complex 
shape since the histogram includes various kinds of 
information of all subjects or every detail in an image. 



Therefore, information of the contrast perceived by a viewer 
of the image is buried in the complex shape, and the histogram 
does not necessarily reflect the viewer's sense of contrast* 
For example, in the case of an image having a human face as 
a subject thereof, a viewer of the image perceives the contrast 
only in the face and not for subjects other than the face in 
the image. However, since a histogram generated from image 
data includes information regarding the subjects other than 
the face, this histogram does not reflect the contrast 
perceived by the viewer. Therefore, if image processing is 
carried out on the image data based on such a histogram, a 
processed image desired by the viewer is not necessarily 
obtained . 

The sense of contrast perceived by a viewer becomes 
different between the cases of sharp colors and dull colors 
included in an image. For example, an image having sharp 
colors therein is perceived as an image having sharp contrast 
while an image including colors which are not so sharp is 
perceived as an image having weak contrast. Therefore, since 
the sense of contrast becomes different due to colors included 
in an image, image processing considering the colors of an 
image needs to be carried out. 

The present invention has been conceived based on 
consideration of the above problems . An object of the present 
invention is therefore to provide a method and an apparatus 



for quantifying a sense of contrast perceived by a viewer of 
an image and for carrying out adequate* image processing on 
the image based on the sense of contrast, and also to provide 
a computer-readable recording medium storing a program to 

5 cause a computer to execute the image processing. 

Another object of the present invention is to provide 
a method and an apparatus for carrying out adequate image 
processing on an image by using color information of the image, 
and also to provide a computer-readable recording medium 

0 storing a program to cause a computer to execute the image 
processing . 

SUMMARY OF THE INVENTION 
When a viewer observes an image and judges the contrast 
thereof, the contrast is judged based on not only a shade 
5 difference of all subjects as a whole but also information 
not reflected in a histogram, such as a shade difference of 
the entire image, distributions of dark and light portions 
therein, a distribution of lightness only in a subject of 
interest, and the like. The present invention has been 
0 conceived by paying attention to this fact. 

In other words, a first image processing method of the 
present invention is characterized by the fact that the sense 
of contrast of an image represented by image data is quantified 
based on the image data. 
5 The "sense of contrast" herein referred to means a 
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subjective sense regarding contrast of an image perceived by 
a viewer and not directly reflected in a histogram of the image 
itself, such as a shade difference of the entire image, a 
distribution of dark and light portions in the image, and a 

5 lightness distribution only in a subject of interest. More 
specifically, the sense of contrast can be quantified based 
on a histogram of unsharp image data of the image data, 
information of positions of a light portion and/or a dark 
portion in an unsharp image represented by the unsharp image 

0 data, and a histogram or the like obtained by multi-resolution 
image data in each of frequency bands generated by conversion 
of the image data into multiple resolutions, for example. 

Although the histogram can be generated from the unsharp 
image data themselves, the histogram may be generated from 

5 unsharp image data converted into 32-bit numbers, hexadecimal 
numbers or octal numbers when the image data has 8-bit (256 ) 
information, for example. 

Furthermore, luminance data and color data representing 
luminance information and color information of an image may 

0 be obtained from the image data. Unsharp luminance image data 
and/or unsharp color image data which are unsharp image data 
of the luminance data and/or the color data are then generated. 
A luminance histogram and/or a color histogram are generated 
from the unsharp luminance image data and/or the unsharp color 

5 image data, and based on the luminance histogram and/or the 
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color histogram, the sense of contrast may be quantified* The 
"color information" refers to information representing 
sharpness of a color included in an image. 

When the unsharp color image data are generated, a color 
histogram representing a two-dimensional frequency 
distribution of the unsharp color image data may be used. 

Moreover, as the "position information of a light 
portion and/or a dark portion", standard deviation of a 
distance from the center of an image to the light portion 
and/or the dark portion can be used. 

A phrase stating "based on the histogram or the like 
obtained from multi-resolution image data" refers to the case 
of quantification of the sense of contrast based on a rough 
lightness distribution of an image found by a low-frequency 
band image represented by image data at a resolution in a low 
frequency band generated from image data, and based on a 
histogram of a medium-frequency band image or a high-frequency 
band image represented by image data at a resolution of a 
medium frequency band or a resolution of a high frequency band 
generated from the image data, for example. 

The luminance data and the color data representing the 
luminance information and the color information of an image 
may be obtained from image data. The luminance data and the 
color data are then converted into multiple resolutions so 
that multi-resolution luminance image data and multi- 



resolution color image data in a plurality of frequency bands 
are obtained. The sense of contrast may be quantified based 
on luminance histograms and/or color histograms which are 
histograms of the multi-resolution luminance image data and 
the multi-resolution color image data. 

In the first image processing method of the present 
invention, it is preferable for image processing to be carried 
out on the image data based on the sense of contrast. 

In this case, it is preferable for the image processing 
to be at least one of tone conversion processing, frequency 
enhancing processing, AE processing and chroma conversion 
processing . 

A second image processing method of the present 
invention is characterized by the fact that image processing 
for changing luminance information of an image is carried out 
on image data based on color information of the image 
represented by the image data. 

In the second image processing method of the present 
invention, it is preferable for the image processing to be 
carried out on the image data according to the steps of: 

obtaining color data representing color information of 
the image from the image data; 

generating unsharp image data of the color data; 

generating a histogram of the unsharp image data; and 

carrying out the image processing on the image data based 



on the histogram. 

In this case, a histogram representing a two-dimensional 
frequency distribution of the unsharp image data is preferably 
generated . 

In the second image processing method of the present 
invention, it is preferable for the image processing to be 
carried out according to the steps of: 

obtaining color data representing color information of 
the image based on the image data; 

obtaining multi-resolution image data in a plurality 
of frequency bands by converting the color data into multiple 
resolutions ; 

generating a histogram of multi-resolution data in a 
lowermost frequency band out of the multi-resolution image 
data in the plurality of frequency bands; and 

carrying out the image processing on the image data based 
on the histogram. 

A first image processing apparatus of the present 
invention is characterized by the fact that the apparatus has 
contrast-sense quantification means for quantifying a sense 
of contrast of an image represented by image data, based on 
the image data. 

In the first image processing apparatus of the present 
invention, it is preferable for the contrast-sense 
quantification means to comprise: 



8 



unsharp image data generating means for generating 
unsharp image data of the image data; 

histogram generating means for generating a histogram 
of the unsharp image data; and 
5 quantification means for quantifying the sense of 

contrast based on the histogram. 

In the first image processing apparatus of the present 
invention, it is preferable for the contrast-sense 
quantification means to comprise: 
0 conversion means for obtaining luminance data and color 

data representing luminance information and color 
information of the image from the image data; 

unsharp image data generating means for generating 
unsharp luminance image data and/or unsharp color image data 
5 which are unsharp image data of the luminance data and/or the 
color data; 

histogram generating means for generating a luminance 
histogram and/or a color histogram which are histograms of 
the unsharp luminance image data and/or the unsharp color 
0 image data; and 

quantification means for quantifying the sense of 
contrast based on the luminance histogram and/or the color 
histogram. 

In the case where the unsharp image data generating means 
5 generates the unsharp color image data, it is preferable for 
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the histogram generating means to generate a color histogram 
representing a two-dimensional frequency distribution of the 
unsharp color image data. 

Furthermore, it is preferable for the contrast-sense 
5 quantification means to comprise: 

unsharp image data generating means for generating 
unsharp image data of the image data; and 

quantification means for quantifying the sense of 
contrast based on position information of a light portion 
0 and/or a dark portion in an unsharp image represented by the 
unsharp image data. 

It is also preferable for the contrast-sense 
quantification means to comprise: 

multi-resolution conversion means for obtaining 
5 multi-resolution image data in a plurality of frequency bands 
by converting the image data into multiple resolutions; 

histogram generating means for generating a histogram 
of the multi-resolution image data; and 

quantification means for quantifying the sense of 
0 contrast based on the histogram. 

Furthermore, it is also preferable for the 
contrast-sense quantification means to comprise: 

conversion means for obtaining luminance data and/or 
color data representing luminance information and/or color 
5 information from the image data; 
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multi-resolution conversion means for obtaining 
multi-resolution luminance data and/or multi-resolution 
color data in a plurality of frequency bands by converting 
the luminance data and/or the color data into multiple 
resolutions ; 

histogram generating means for generating a luminance 
histogram and/or a color histogram which are histograms of 
the multi-resolution luminance image data and/or the 
multi-resolution color image data; and 

quantification means for quantifying the sense of 
contrast based on the luminance histogram and/or the color 
histogram. 

It is preferable for the first image processing 
apparatus of the present invention to further comprise 
processing means for carrying out image processing on the 
image data based on the sense of contrast. 

In this case, it is preferable for the processing means 
to carry out, as the image processing, at least one of tone 
conversion processing, frequency enhancing processing, AE 
processing, and chroma conversion processing. 

A second image processing apparatus of the present 
invention is characterized by the fact that image processing 
for changing luminance information of an image represented 
by image data is carried out on the image data based on color 
information of the image. 



It is preferable for the second image processing 
apparatus of the present invention to comprise: 

conversion means for obtaining color data representing 
the color information from the image data; 
5 unsharp image data generating means for generating 

unsharp image data of the color data; 

histogram generating means for generating a histogram 
of the unsharp image data; and 

processing means for carrying out the image processing 
^10 on the image data based on the histogram. 

j It is preferable for the histogram generating means to 

I generate a histogram representing a two-dimensional 

~ frequency distribution of the unsharp image data. 

3 It is preferable for the second image processing 

*15 apparatus of the present invention to comprise: 
z conversion means for obtaining color data representing 

color information of the image from the image data; 

multi-resolution conversion means for obtaining 
multi-resolution image data in a plurality of frequency bands 
20 by converting the color data into multiple resolutions; 

histogram generating means for generating a histogram 
of multi-resolution image data in a lowermost frequency band 
out of the multi-resolution image data in the plurality of 
frequency bands; and 
25 processing means for carrying out the image processing 
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on the image data based on the histogram. 

The first image processing method and the second image 
processing method of the present invention may be provided 
as a computer-readable recording medium storing a program to 
5 cause a computer to execute the methods. 

According to the present invention, the sense of 
contrast of an image represented by image data can be 
quantified. Therefore, it is possible to quantify not the 
contrast including various kinds of information of an entire 
!lAo image, such as contrast found by a histogram of the image 
yj itself, but a subjective sense perceived by a viewer of the 

63 image, such as a shade difference of the entire image, a 

=P distribution of a light portion and a dark portion in the image, 

«f a lightness distribution in a subject of interest, and 

ri5 information of colors included in the image. 
S Since not only information perceived by a viewer but 

also a substantially large amount of information is included 
in an image represented by image data, lightness information 
of the overall image is buried in a histogram generated from 
20 the image data. Meanwhile, by generating unsharp image data 
from the image data, an image represented by the unsharp image 
data does not include a detailed change in pixel values of 
a subject unlike the original image data, and represents the 
shade difference of the entire image perceived by a viewer. 
25 Therefore, the sense of contrast regarding an image can be 
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quantified by being based on the unsharp image data or a 
histogram of luminance data and/or color data obtained from 
the image data. 

The position information of a light portion and/or a 
dark portion in an unsharp image represents a position of a 
light subject and/or a dark subject in an image. Therefore, 
based on the position information, a lightness distribution 
of the image can be represented as the sense of contrast. 

In the case where histograms of multi-resolution image 
data in a plurality of frequency bands are generated by 
conversion of image data into the multi-resolution image data, 
a histogram of the image data at a resolution in a lowermost 
frequency band represents a lightness distribution of the 
entire image, as does the histogram of unsharp image data. 
Meanwhile, a histogram of image data at a resolution in a 
medium or high frequency band represents amplitude of a 
frequency component corresponding to the frequency band. For 
example, a shade of a face generated by the nose or hollows 
of the eyes, or a shade generated by a building or a subject 
is formed with the medium frequency component while details 
of trees or flowers, a pattern and texture of a person's 
clothes, a boundary (an edge) between objects and the like 
are represented by the high frequency component. Therefore, 
the more an image has local contrast, the wider a distribution 
width of the histogram of the image data in the medium or high 



frequency band becomes. Consequently, the sense of contrast 
of the entire image data can be quantified by the histogram 
of the image data in the low frequency band, and the sense 
of local contrast can also be quantified based on the histogram 
of the image data in the medium and high frequency bands. In 
this manner, not only the lightness distribution in an entire 
image but also a local lightness distribution can be found 
as the sense of contrast. 

Meanwhile, in the case where the luminance data and the 
color data are obtained from the image data and the luminance 
histogram and/or the color histogram of the multi-resolution 
image data are generated by converting the luminance data 
and/or the color data into the multi-resolution image data, 
a luminance histogram in a low frequency band represents a 
lightness distribution in an entire image while a luminance 
histogram in a medium to high frequency band represents an 
amplitude of a frequency component corresponding to the 
frequency band. Therefore, the sense of contrast of an entire 
image can be quantified based on the luminance histogram in 
the low frequency band. Furthermore, the sense of local 
contrast can be represented based on the luminance histogram 
in the medium and high frequency bands. 

The color histogram in the low frequency band represents 
a chroma distribution of an image as a whole and the color 
histogram in the medium or high frequency band represents a 
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chroma distribution corresponding to the frequency band. 
Therefore, the sense of contrast of an entire image based on 
colors therein can be quantified based on the color histogram 
in the low frequency band, and the sense of local contrast 
can be quantified based on the color histogram in the medium 
and high frequency bands* 

Furthermore, by carrying out predetermined image 
processing on the image data based on the sense of contrast 
having been found, processed image data reflecting the sense 
of contrast perceived by a viewer can be obtained. 

Moreover, by carrying out image processing for changing 
the luminance information on the image data based on the color 
information of an image represented by the image data, 
processed image data reflecting the sense of contrast 
perceived by a viewer and induced by the color of the image 
can be obtained. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram showing an outline 
configuration of an image processing apparatus according to 
an embodiment of the present invention; 

Figure 2 is a block diagram showing an outline 
configuration of a first embodiment of contrast-sense 
quantification means; 

Figure 3 shows illustrations explaining how unsharp 
image data are generated; 



Figure 4 is an example of a histogram of the unsharp 
image data; 

Figure 5 is another example of the histogram of the 
unsharp image data; 

Figure 6 is a diagram showing tone conversion look- 
up tables; 

Figure 7 is a flow chart showing processing carried out 
in the first embodiment; 

Figure 8 is a histogram after converting the unsharp 
image data into hexadecimal numbers; 

Figure 9 is a block diagram showing an outline 
configuration of a second embodiment of the contrast-sense 
quantification means; 

Figures 10A and 10B show two-dimensional histograms; 

Figure 11 is a block diagram showing an outline 
configuration of a third embodiment of the contrast-sense 
quantification means ; 

Figure 12 is a diagram explaining processing carried 
out in the third embodiment; 

Figure 13 is a diagram explaining processing carried 
out in a modification of the third embodiment; 

Figure 14 is a block diagram showing an outline 
configuration of a fourth embodiment of the contrast-sense 
quantification means ; 

Figures ISA through 15C are illustrations of images 



represented by data at resolutions in each frequency band; 

Figure 16 shows histograms of the data at the resolutions 
in each frequency band; 

Figure 17 is a block diagram showing an outline 
configuration of a fifth embodiment of the contrast-sense 
quantification means; 

Figure 18 explains frequency enhancing processing; 
Figure 19 is a block diagram showing an outline 
configuration of processing means carrying out AE process ing ; 
Figures 20A and 20B explain the AE processing; 
Figure 21 is a block diagram showing an outline 
configuration of the image processing apparatus according to 
another embodiment of the present invention; 

Figure 22 is a flow chart showing processing carried 
out in the embodiment; and 

Figure 23 is a block diagram showing an outline 
configuration of the image processing apparatus according to 
still another embodiment of the present invention* 
DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Hereinafter, embodiments of the present invention will 
be explained with reference to the accompanying drawings. 

Figure 1 is a block diagram showing an outline 
configuration of an image processing apparatus according to 
an embodiment of the present invention. The image processing 
apparatus according to this embodiment comprises 
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contrast-sense quantification means 1 for quantifying the 
sense of contrast CO of an image represented by image data 
SO, processing means 2 for obtaining processed image data SI 
by carrying out image processing on the image data SO based 
on the sense of contrast CO having been quantified by the 
contrast-sense quantification means 1, and output means 3 such 
as a printer or a CRT monitor for outputting the processed 
image data Si as a visible image. 

Figure 2 is a block diagram showing a specific outline 
configuration of the contrast-sense quantification means 1. 
The contrast-sense quantification means 1 shown in Figure 2 
is explained as a first embodiment. As shown in Figure 2, 
the contrast-sense quantification means 1 in the first 
embodiment comprises unsharp image generating means 11 for 
generating unsharp image data Sus of the image data SO, 
histogram generating means 12 for generating a histogram Hus 
of the unsharp image data Sus, and quantification means 13 
for finding the sense of contrast CO of the image represented 
by the image data SO based on the histogram Hus. 

In the contrast-sense quantification means 1 shown in 
Figure 2, the sense of contrast CO is quantified in the 
following manner. First, the unsharp image data Sus of the 
image data SO are generated by the unsharp image generating 
means 11. The unsharp image data Sus are generated by 
carrying out filtering processing using an unsharp mask filter 
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on the image data SO, for example* Examples of images 
represented by the image data SO and the unsharp image data 
Sus are shown in Figure 3. In Figure 3, the images represented 
by the image data SO and the unsharp image data Sus have the 

5 reference codes SO and Sus respectively. In the unsharp image 
data Sus, only a frequency band several percent of the Nyquist 
frequency of the image data SO exists. More specifically, 
the unsharp image data Sus represent a frequency component 
of 0.5 - 3 cycles /cm in the image represented by the image 

0 data SO. 

The histogram generating means 12 generates the 
histogram Hus of the unsharp image data Sus. Figure 4 shows 
the histogram Hus of the unsharp image data Sus together with 
a histogram HO of the image data SO . In Figure 4 , pixel values 

5 are normalized to 0-100. As shown in Figure 4, the histogram 
HO has a complex shape since the histogram includes not only 
a lightness distribution in the entire image but also various 
kinds of information in all subjects and every detail in the 
image. The shade difference, that is, the contrast found from 

0 the histogram HO ranges from 0-100, which is substantially 
wide. Figure 5 shows histograms HO' and Hus' generated from 
image data SO' different from the image data SO and unsharp 
image data Sus ' generated from the image data SO ' . Comparison 
of Figure 4 with Figure 5 reveals different shapes of the 

5 histograms. However, although the shapes of the two 
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histograms HO and HO' are obviously different, the contrast 
found from the histogram HO' in Figure 5 ranges widely from 
0 to 100 as the contrast found from the histogram HO shown 
in Figure 4 . Therefore, the contrast is not different between 
5 the images. 

Meanwhile, the histogram Hus has a distribution width 
27-92 narrower than that of the histogram HO, and excludes 
information of the details in the image. This distribution 
width represents the shade difference of the entire image, 
10 that is, the contrast of the image. Although the contrast found 
by the histogram HO' in Figure 5 is the same as that of the 
histogram shown in Figure 4, a distribution width of the 
histogram Hus' is 17-75 which is different from the histogram 
Hus in Figure 4 . Therefore, the two histograms have different 
15 distribution widths and distribution positions, and the 
contrast becomes different between the images . When a viewer 
observes an image, the viewer judges the contrast by observing 
the entire image and not the details thereof. Therefore, in 
the first embodiment, the distribution width of the unsharp 
2 0 image data Sus, that is, a difference w between a maximum 
Husmax and a minimum Husmin in the histogram Hus is found by 
the quantification means 13, and the difference w is used as 
the sense of contrast CO of the entire image perceived by a 
viewer . 

25 In the processing means 2, image processing is carried 



21 



out on the image data SO based on the sense of contrast CO 
quantified by the contrast-sense quantification means 1. A 
type of contrast of the image represented by the image data 
SO is found by comparing the sense of contrast CO, that is , 
' 5 the difference w between the maximum Husmax and the minimum 
Husmin in the histogram Hus with a threshold value Thl set 
in advance. The threshold value Thl is set to approximately 
50 in the case where the pixel values of the entire histogram 
change in the range 0-100 as shown in Figures 4 and 5 . However, 
LjLO the threshold value is not always limited to this example* 
ill if CO ^ Thl, the image represented by the image data SO is 

m judged as a high-contrast image, while the image is classified 

^ as a low-contrast image if CO < Thl. In this case, two 

O threshold values Thl and Th2 such as 0<Th2<Thl<100 may be set 

r*15 so that the image is judged to be a high-contrast image when 
y C0>Thl while a standard image and a low-contrast image in the 

case of Th2^C0^Thl and in the case of C0<Th2, respectively. 
Thl is set to approximately 80 and Th2 is set to around 40. 
However, the threshold values are not limited to these 
2 0 numbers. 

When the contrast type of the image is found in the above 
manner, one of tone conversion look-up tables (LUTs) prepared 
in accordance with the contrast types is selected and tone 
conversion processing according to the selected tone 
25 conversion LUT is carried out on the image data SO. Figure 
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6 is a diagram showing the tone conversion LUTs . In this 
embodiment, five tone conversion LUTs LUT1-LUT5 are used. In 
the case where the image has been judged to be a high-contrast 
image, LUTS is used. For the image judged to be a low-contrast 
image or a standard image, the LUT 1 or the LUT3 are used, 
respectively- The image processing for obtaining the 
processed image data SI is carried out by conversion of the 
tones of the image data SO using the LUT described above. The 
LUT may be selected from the LUTl through LUT 5 according to 
the sense of contrast CO, that is, according to the difference 
w • 

A tone curve represented by a function such as yout=a • 
yin+b ( yout : output , yin: input) may be set by changing the 
parameters a and b according to the contrast type or according 
to the sense of contrast CO (the value of w) . 

Operation of the first embodiment will be explained 

next . 

Figure 7 is a flow chart showing the operation of the 
first embodiment. In the flow chart shown in Figure 7, the 
sense of contrast CO is compared with the two threshold values 
Thl and Th2 . The unsharp image data Sus of the image data 
SO are generated in the unsharp image generating means 11 in 
the contrast-sense quantification means 1 (Step SI), and the 
histogram Hus of the unsharp image data Sus is generated in 
the histogram generating means 12 (Step S2). The 



quantification means 13 finds the sense of contrast CO based 
on the histogram Hus (Step S3). The sense of contrast CO 
having been found is then input to the processing means 2, 
and the processing means judges whether C0>thl is confirmed 
or not (Step S4). When the judgment result is affirmative, 
the image is judged to be a high-contrast image and the tone 
conversion LUT5 is selected for the high-contrast image (Step 
S5). The tone conversion processing is carried out on the 
image data SO (Step S6) to obtain the processed image data 
SI. The processed image data Si are then output as a visible 
image from the output means 3 (Step S7). 

When the judgment result at Step S4 is negative, the 
processing means judges whether C0<Th2 is confirmed or not 
(Step S8) . When the judgment result is affirmative, the tone 
conversion LUTl is selected (Step S9), since the image is 
judged to be a low-contrast image. Based on the LUTl, the 
tone conversion processing is carried out on the image data 
SO (Step S6). When the judgment result is negative at Step 
S8, the image is judged to be the standard image satisfying 
Th2^C0^Thl, and the tone conversion LUT3 is selected (Step 
10). Based on the LUT3 , the tone conversion processing is 
carried out on the image data SO (Step S6). 

In the image represented by the image data SO, not only 
information perceived by the viewer of the image but also a 
large amount of information is included. Therefore, 



lightness information of the entire image is buried in the 
histogram HO generated from the image data SO. Meanwhile, 
the image represented by the unsharp image data Sus of the 
image data SO represents the shade difference of the entire 
image perceived by the viewer, since a detailed change in the 
pixel values of a subject in the image is not included, unlike 
the image data SO. Therefore, the sense of contrast CO 
perceived by the viewer can be quantified by being based on 
the histogram Hus of the unsharp image data Sus. By carrying 
out the tone conversion processing on the image data SO based 
on the sense of contrast CO, the processed image data SI 
representing an image reflecting the sense of contrast CO 
perceived by the viewer can be obtained. 

In the first embodiment, the histogram HO is generated 
from the unsharp image data Sus. However, in the case where 
the unsharp image data Sus have 8-bit data values (0-255), 
the unsharp image data may be converted into hexadecimal 
numbers and the histogram may be generated from the unsharp 
image data Sus having the hexadecimal numbers. At this time, 
since the unsharp image data Sus, unlike the image data SO, 
do not include information of the detail of the image, the 
distribution width of the histogram Hus generated after the 
conversion into hexadecimal numbers does not change 
substantially as shown in Figure 8 when compared with the 
histogram generated from the 8-bit unsharp image data Sus. 



Consequently, the sense of contrast CO obtained therefrom does 1 
not change greatly before and after the conversion into 
hexadecimal numbers. Since the amount of pixel-value data 
is reduced if the conversion into hexadecimal numbers is 
carried out, the histogram can be generated easily. 
Therefore, by generating the histogram after the conversion 
of the unsharp image data Sus into hexadecimal numbers is 
carried out, processing can be made faster. In this case, 
the data values of the unsharp image data Sus have been 
converted into hexadecimal numbers. However, if the data 
values are to be made smaller than the 8-bit data, the 
histogram may be generated after conversion into octal numbers 
or 32-bit numbers, for example. 

In the above embodiment, the sense of contrast CO has 
been defined as the difference w between the maximum Husmax 
and the minimum Husmin in the histogram Hus . However, a pixel 
value at a position smaller than the maximum Husmax by 10% 
of ( Husmax-Husmin ) and a pixel value at a position larger than 
the minimum Husmin by 10% of (Husmax-Husmin) may be found so 
that the sense of contrast CO is defined as a difference 
between these pixel values . 

Furthermore, in the first embodiment described above, 
the unsharp image data Sus have been generated from the image 
data SO to quantify the sense of contrast CO based on the 
histogram Hus of the unsharp image data Sus. However, the 



image data SO may be converted into luminance data and color 
data representing luminance information and color 
information of the image represented by the image data SO so 
that the sense of contrast CO can be quantified based on a 
histogram of the luminance data and/or the color data. 
Hereinafter, this method will be explained as a second 
embodiment . 

Figure 9 is a block diagram showing an outline 
configuration of the second embodiment of the contrast-sense 
quantification means 1. As shown in Figure 9, the 
contrast-sense quantification means 1 in the second 
embodiment further comprises conversion means 15 for 
converting the image data SO into luminance data L* and color 
data C*, in addition to the unsharp image generating means 
11, the histogram generating means 12, and the quantification 
means 13 in the first embodiment. Unsharp luminance image 
data Lus or unsharp color image data Cus which are unsharp 
image data of the luminance data L* or the color data C* are 
generated by the unsharp image generating means 11, and the 
histogram generating means 12 generates a luminance histogram 
HLus which is a histogram of the unsharp luminance image data 
Lus and a color histogram HCus which is a histogram of the 
unsharp color image data Cus. 

The conversion means 15 converts the image data SO into 
the luminance data L* and the color data C* in the following 



manner. In the second embodiment, the image data SO are 
assumed to comprise RGB color data RO , GO, and BO following 
the standard of ITU-R BT . 7 0 9 ( REC .709) . In the conversion 
means 15, the color data RO , GO, and BO comprising the image 
data SO are converted into CIE1931 tristimulus values X, Y, 
and Z based on the following Equations (1) to (3): 
Pr=R0/255 

Pg=G0/255 (1) 
Pb=B0/255 

Rl' = ( (Pr+0 . 099 )/1 . 099 ) 2 - 222 

Gl' = ( (Pg+0 .099)/1.099) 2 " 222 ( if Pr , Pg , Pb^ 0 . 08 1 ) (2) 
Bl ' = ( (Pb+0 .099 )/1 .099) 2 222 

Rl '=Pr/4 .5 

Gl'=Pg/4.5 (if Pr,Pg,Pb<0.081) (2') 

Bl '=Pb/4 .5 

X RO ' 

Y= I A | . GO' (3) 
Z BO ' 

where the matrix |a| is a matrix for converting the color data 
RO', GO', and BO' into the tristimulus values X, Y, and Z, 
and the following numbers can be used, for example: 
0.4124 0.3576 0.1805 
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lAl = 0.2126 0.7152 0.0722 (4) 
0.0193 0.1192 1.0571 

The tristimulus values X, Y , and Z may be found by using 
a look-up table instead of the matrix I A I . 

CIE1976 L*, a*, and b* are found from the tristimulus 
values X, Y, and Z according to the following Equations (5) 
to ( 7 ) : 

a*= 500 -{ f ( X/Xn ) - f ( Y/Yn ) } (5) 

b*= 200{f (Y/Yn)-f (Z/Zn) } (6) 

L*= 116(Y/Yn) 1/3 -16 (if Y/Yn>0. 008856) (7) 

L*= 903 .25(Y/Yn) (if Y/YnS 0 . 008856 ) 

When X/Xn, Y/Yn, Z/Zn >0. 008856, 

f (a/an) = (a/an) 1/3 (a=X, Y, Z) 

When X/Xn, Y/Yn, z/Zn^ 0 . 008856 , 
f ( a/an) =7 .787 (a/an) +16/1 16 

The values Xn, Yn, and Zn are tristimulus values for a white 

color and corresponding to CIE-D65 (a light source whose color 

temperature is 6500K) . The chroma C* is then found according 

to the following Equation (8): 

C*=( a* 2 +b* 2 ) 1/2 (8) 

L* and C* are then output as the luminance data L* and the 

color data C* . 

From the luminance data L* or the color data C* , the 

unsharp luminance image data Lus and the unsharp color image 

data Cus which are the unsharp image data of the luminance 



29 



data L* or the color data C* are generated by the unsharp image 
generating means 11 , as in the first embodiment. For the 
color data C*, a degree of unsharpness can be lower than that 
of the luminance data L*, taking not only an overall color 
" 5 change but also an influence of the medium frequency component 
such as fine glasses and flowers into consideration. More 
specifically, the unsharp color image data Cus preferably 
represents frequency components such as 0.5-10 cycles/cm in 
the image represented by the image data SO. 
^10 As in the first embodiment, the histogram generating 

yj means 12 generates the luminance histogram HLus or the color 

fB histogram HCus from the unsharp luminance image data Lus or 

42 the unsharp color image data Cus, respectively. 

Q The quantification means 13 finds the distribution width 

Hl5 of the luminance histogram HLus or the color histogram HCus 
2? to be output as the sense of contrast CO. 

Based on the sense of contrast having been found in the 
above manner, the processing means 2 carries out image 
processing on the image data SO. More specifically, the type 
20 of contrast of the image represented by the image data SO is 
found based on the sense of contrast CO, as in the first 
embodiment. The tone conversion LUT according to the type 
is selected and the tone conversion processing is carried out 
on the image data SO by using the tone conversion LUT having 
25 been selected. 
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In the case where the sense of contrast CO is found from 
the color data C* in the second embodiment , chroma conversion 
processing for causing the chroma of the image represented 
by the image data SO to increase may be carried out if the 
type of contrast found from the sense of contrast CO is low. 
More specifically, the chroma is improved by multiplying the 
chroma C* found from Equation (8) with an enhancement 
coefficient a c. As a value of the coefficient a c, 
approximately 1.2 is preferable. However, the value is not 
limited to this example. Furthermore, the tone conversion 
processing and the chroma conversion processing may be carried 
out at the same time. 

In the case where the chroma is improved, not only 
multiplication with the uniform coefficient ac for the entire 
image represented by the image data SO but also multiplication 
with ac as a function of chroma may be carried out so that 
an area of low chroma in the image has more improved chroma. 
The coefficient ac may be changed in accordance with a hue 
angle H ( =tan~ x ( b*/a* ) ) . 

In the second embodiment, the conversion means 15 finds 
the chroma C* according to Equation (8) and uses C* as the 
color data. However, a* and b* found from Equations (5) and 
(7) may be used as the color data. In this case, the unsharp 
image generating means 11 finds unsharp color image data aus 
and bus of a* and b*, and the histogram generating means 12 



generates a two-dimensional histogram Hab from the unsharp 
color image data aus and bus. Figure 10 shows an example of 
the two-dimensional histogram Hab. In Figure 10, a distance 
from the origin represents the chroma. The sharper a color 
"5 is, the farther the color is located from the origin. 

Therefore, when the image represented by the image data SO 
has a multitude of vivid colors, a distribution of the 
two-dimensional histogram Hab is widened. For example, in 
Figures 10(a) and 10(b), the image from which the two- 
rio dimensional histogram Hab shown in Figure 10(b) is generated 
Ui has sharper colors, since the distribution is wider in Figure 

i 10(b). 

HF Therefore, by finding a distribution area Ac of the 

y two-dimensional histogram Hab, the area can be used as the 

H15 sense of contrast CO. Based on the sense of contrast CO, the 
type of contrast of the image represented by the image data 
SO is found as in the first embodiment, and image processing 
such as the tone conversion processing and the chroma 
conversion processing can be carried out on the image data 
20 SO . 

In the second embodiment, the sense of contrast CO may 
be defined as a ratio R=P/P ali where P is the number of pixels 
having the color data C* equal to or larger than a 
predetermined threshold value and P all is the number of all 
25 the pixels in the image represented by the image data SO* More 
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specifically, in the aus-bus plane shown in Figure 10, a 
circular area centering on the origin and having a 
predetermined radius (a radius corresponding to the threshold 
value) is set and pixels not included in the circle are counted 
as the pixels P and the ratio R which is the ratio of P to 
the number of all pixels P all is found as the sense of contrast 
CO . 

In the first embodiment described above, the histogram 
Hus of the unsharp image data Sus of the image data SO have 
been generated, and the sense of contrast CO has been 
quantified based on the histogram Hus. However, the sense 
of contrast CO may be found as a distribution of a light portion 
and/or a dark portion in an image. Hereinafter, this method 
will be explained as a third embodiment. Figure 11 is a block 
diagram showing an outline configuration of the third 
embodiment of the contrast-sense quantification means 1. As 
shown in Figure 11, the contrast-sense quantification means 
1 in the third embodiment comprises unsharp image generating 
means 21 for generating the unsharp image data Sus of the image 
data SO, hexadecimal conversion means 22 for obtaining 
hexadecimal unsharp image data Susl6 by converting the unsharp 
image data Sus into hexadecimal numbers 0-15, position 
detection means 23 for detecting a position of a pixel having 
the maximum number 15 in an image represented by the 
hexadecimal unsharp image data Susl6, and operation means 24 



for finding a distance between the pixel position detected 
by the position detection means 23 and the center 0 of the 
image and for calculating a standard deviation <7 of the 
distance defined as the sense of contrast CO. The sense of 
contrast CO calculated in the above manner quantifies a 
distribution of the light portion perceived by a viewer of 
the image. 

When the standard deviation 0 calculated by the 
operation means 24 is comparatively small, the image is judged 
to be an image having the light portion concentrated around 
the center thereof (for example, a flash image obtained by 
photographing using a flash), and image processing adequate 
therefor is carried out by the processing means 2. In the 
third embodiment, the processing means 2 judges whether or 
not the sense of contrast CO, that is, the standard deviation 
a found by the contrast-sense quantification means 1 is 
smaller than a predetermined threshold value Th5 . When O 
<Th5, the image is judged to be a flash image having the light 
portion concentrated around the center thereof, and image 
processing adequate therefor is carried out on the image data 
SO. When a^Th5, the image is judged to be a standard image 
and image processing adequate therefor is carried out on the 

image data SO . 

In a flash image, the contrast increases, since strong 
light is irradiated on a subject thereof. Therefore, the 



subject appears whiter reflecting the flash. For this reason, 
the processing means 2 extracts the light portion from the 
image represented by the image data SO when a <Th5 , and carries 
out the tone conversion processing using the LUT5 shown in 
Figure 6 on the image data SO in the portion so as to suppress 
the contrast. In this manner, the contrast in the light 
portion is suppressed and it is possible to obtain processed 
image data Si representing an image having no strong 
reflection . 

in the third embodiment described above, the sense of 
contrast CO has been defined as the standard deviation O of 
the distance between the pixel position found by the position 
detection means 23 and the image center 0. However, as shown 
in Figure 13, an area Al having a predetermined area around 
the center 0 is set and the number of pixels having the 
hexadecimal number 15 in the area Al may be counted as the 
sense of contrast CO. In this case, the processing means 2 
judges whether or not the sense of contrast CO, that is, the 
number of the pixels having the hexadecimal number 15 in the 
area Al , is larger than a predetermined threshold value Th6 . 
When C0>Th6, the image is judged to be an image having a light 
portion concentrated around the center thereof, and the 
processing means 2 carries out the tone conversion processing 
for suppressing the contrast in the area Al . When C0^Th6, 
the image is judged to be a standard image and the processing 



means 2 carries out the image processing adequate therefor. 
In this manner, the processed image data SI representing the 
image having no strong reflection and suppressed contrast in 
the light portion can be obtained. 

in the first embodiment, the unsharp image data Sus of 
the image data SO have been generated and the histogram of 
the unsharp image data Sus has been found to be used for 
quantifying the sense of contrast CO . However, the image data 
SO may be converted into a multi-resolution space in a 
plurality of frequency bands so that histograms of the data 
at the resolutions in the frequency bands are generated to 
be used for quantification of the sense of contrast CO. 
Hereinafter, this method will be explained as a fourth 
embodiment . 

Figure 14 is a block diagram showing an outline 
configuration of the contrast-sense quantification means 1 
in the fourth embodiment. As shown in Figure 14, the 
contrast-sense quantification means 1 in the fourth 
embodiment comprises multi-resolution conversion means 31 
for obtaining multi-resolution image data (hereinafter 
called resolution data) RL, RM, and RH in a low frequency band, 
a medium frequency band, and a high frequency band 
respectively by converting the image data SO into a 
multi-resolution space by using a method such as wavelet 
transform and Laplacian pyramid, area extracting means 32 for 



extracting, as a light portion Ml, an area in which pixel 
values are equal to or larger than a predetermined threshold 
value Th7 from the resolution data RL in the low frequency 
band, histogram generating means 33 for generating histograms 
HM and HH of an area corresponding to the light portion Ml 
regarding the resolution data RM and RH in the medium frequency 
band and in the high frequency band, and quantification means 
34 for quantifying the sense of contrast CO of the image 
represented by the image data SO. 

in the contrast-sense quantification means 1 in the 
fourth embodiment, the sense of contrast CO is found in the 
following manner- First, the image data SO are converted into 
the multi-resolution space by the multi-resolution 
conversion means 31 and the resolution data RL, RM and RH in 
the low, medium, and high frequency bands are generated. The 
resolution data RL in the low frequency band include 
information of lightness while the resolution data RM and RH 
in the medium and high frequency bands represent frequency 
components only. In Figure 15, Figures 15(a), 15(b), and 
15(c) show images represented by the resolution data in the 
low frequency band, in the medium frequency band, and in the 
high frequency band, respectively. 

The resolution data RL in the low frequency band are 
input to the area extracting means 32 and the area in which 
the pixel values are equal to or larger than the threshold 



value Th7 is extracted as the light portion Ml to be input 
to the histogram generating means 33. Meanwhile, the number 
n of the pixels in the light portion Ml is input to the 
quantification means 34. The histogram generating means 33 

5 generates the histograms HM and HH corresponding to the light 
portion Ml regarding the resolution data RM and RH in the 
medium and high frequency bands . 

A distribution width BL of a histogram HL of the 
resolution data RL in the low frequency band shows a 

0 distribution of pixel values as in Figure 16(a), and 
represents overall lightness of the image, as do the 
histograms shown in Figures 4 and 5 do. Distribution widths 
BM and BH of the histograms HM and HH of the resolution data 
RM and RH in the medium and high frequency bands show 

5 amplitudes of frequencies centering on 0 as shown in Figures 
16(b) and (c). 

For example, a shade of a face generated by the nose 
or hollows of the eyes, and a shade generated by a building 
or a subject is formed with frequency components in the medium 

0 frequency band higher than the low frequency band. Therefore, 
the more an image has local contrast of a subject such as a 
face, the larger the local shade becomes. As a result, the 
amplitude of the resolution data RM in the medium frequency 
band becomes large. Meanwhile, details of trees or flowers, 

5 a pattern and texture of a person's clothes, a boundary (an 
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edge) between objects and the like are formed with the high 
frequency component. Therefore, the larger the contrast of 
a local area corresponding to the detailed structure becomes, 
the clearer the detailed structure appears. As a result, the 
5 amplitude of the resolution data RH in the high frequency band 
becomes larger. 

The quantification means 34 quantifies the sense of 
contrast CO based on the histograms HM and HH. First, the 
distribution width BM in the histogram HM of the resolution 
JjlO data RM in the medium frequency band is compared with a 
Ly predetermined threshold value Th8 • If the distribution width 

CO BM of the histogram HM is larger than the threshold value Th8 

HF (BM>Th8), the image is judged to be a standard image having 

5f a comparatively large amount of information of the medium 

r. 15 frequency band. If the width BM is equal to or smaller than 
q the threshold value Th8 (BM^Th8), the image is judged to be 

a low-contrast image not including a substantially large 
amount of information of the medium frequency band. In the 
case where the image is judged to be the standard image, the 
20 distribution width BH in the histogram HH of the resolution 
data RH in the high frequency band may be compared with a 
predetermined threshold value Th9 so that the image can be 
judged to be a high-contrast image including a comparatively 
large amount of high frequency information if the distribution 
25 width BH is larger than the threshold value Th9 (BH>Th9). 



39 



Otherwise (BH^Th9) the image is judged to be the standard 
image not including a substantial amount of the high frequency 
information. Meanwhile, the number n of the pixels in the 
light portion Ml extracted by the area extracting means 3 2 
" 5 may be compared with a predetermined threshold value ThlO so 
that the image is judged to be the low-contrast image if the 
number n is smaller than the threshold value ThlO (n<ThlO). 
In this case, if the number n is equal to or larger than the 
threshold value ThlO, the type of contrast is judged by using 

JlO the resolution data RM and RH in the medium and high frequency 

IjJ bands, as has been described above. 

GO After the type of contrast has been found in the above 

4= manner, the type of contrast is output as the sense of contrast 

CO. In this case, the sense of contrast CO is a signal having 
[115 a number corresponding to the type of contrast, such as 1 for 
S the low-contrast image, 2 for the high-contrast image, and 

3 for the standard image, for example. 

The processing means 2 carries out on the image data 
SO the image processing for converting the tone by selecting 
20 the tone conversion LUT as in the first embodiment, based on 
the sense of contrast CO quantified by the contrast-sense 
quantification means 1. In this manner, the processed image 
data SI are obtained. 

In the fourth embodiment described above, the luminance 
25 data L* or the color data C* of the image data SO may be found 
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as in the second embodiment . Resolution data of the luminance 
data L* or the color data C* are then obtained by converting 
the luminance data L* or the color data C* into the 
multi-resolution space. The sense of contrast CO is then 
quantified based on the resolution data. Hereinafter, this 
method will be explained as a fifth embodiment. 

Figure 17 is a block diagram showing an outline 
configuration of the contrast-sense quantification means 1 
in the fifth embodiment. As shown in Figure 17, the 
contrast-sense quantification means 1 in the fifth embodiment 
comprises the conversion means 15 in the second embodiment, 
in addition to the multi-resolution conversion means 31, the 
area extracting means 32, the histogram generating means 33 
and the quantification means 34 in the fourth embodiment . The 
multi-resolution conversion means 31 converts the luminance 
data L* or the color data C* into the multi-resolution space 
and obtains luminance resolution data RLL, RML, and RHL or 
color resolution data RLC, RMC, and RHC in the low, medium, 
and high frequency bands. 

In the case where only the luminance resolution data 
RLL, RML and RHL are obtained, the area extracting means 32 
extracts the light portion Ml from the luminance resolution 
data RLL in the low frequency band as in the fourth embodiment, 
and the histogram generating means 33 generates luminance 
histograms HML and HHL corresponding to the light portion Ml 



regarding the resolution data RML and RHL in the medium and 
high frequency bands, respectively. The quantification 
means 34 then quantifies the sense of contrast CO based on 
the luminance histograms HML and HHL . 

In the case where only the color resolution data RLC, 
RMC and RHC are obtained, the area extracting means 32 extracts 
a high-chroma area M2 having data values equal to or larger 
than a predetermined threshold value from an image represented 
by the color resolution data RLC in the low frequency band. 

The color resolution data RMC in the medium frequency 
band represents a shade of a face generated by the nose or 
hollows of the eyes and a shade generated by a building or 
a subject, as the resolution data RM of the image data SO in 
the medium frequency band. The color resolution data RHC in 
the high frequency band also represents detailed structures 
such as details of trees or flowers, a pattern and texture 
of a person' s clothes , and a boundary (an edge) between objects , 
as the resolution data RH of the image data SO in the high 
frequency band. 

Therefore, the histogram generating means 33 generates 
color histograms HMC and HHC of the color resolution data RMC 
and RHC in the medium and high frequency bands regarding the 
high-chroma area M2 extracted by the area extracting means 
32. As in the fourth embodiment above, the quantification 
means 34 then judges the type of contrast by comparing the 



amplitudes of the color histograms HMC and HHC with a 
predetermined threshold value, and the judgment result can 
be obtained as the sense of contrast CO, 

In the case where the sense of contrast CO is found from 
the color data C*, the chroma conversion processing for 
enhancing the chroma of the image represented by the image 
data SO may be carried out based on the sense of contrast CO 
if the type of contrast is a low-contrast image. More 
specifically, the chroma is improved by multiplication of the 
chroma C* found by using Equation (8) with the enhancement 
coefficient ac. As the value of ac, approximately 1.2 is 
preferable, but it is not limited to this value. 

In the fifth embodiment described above, if both the 
luminance resolution data RLL, RML and RHL and the color 
resolution data RLC , RMC , and RHC are obtained, the light 
portion Ml is extracted based on the luminance data RLL in 
the low frequency band and the color histograms HMC and HHC 
corresponding to the light portion Ml are generated for the 
color resolution data RMC and RHC in the medium and high 
f re q Uency bands. Based on the color histograms HMC and HHC, 
the sense of contrast CO can be quantified. Alternatively, 
the high-chroma area M2 may be extracted based on the color 
resolution data RLC in the low frequency band so that the 
luminance histograms HML and HHL corresponding to the 
high-chroma area M2 are generated for the luminance resolution 



data RML and RHL in the medium and high frequency bands to 
quantify the sense of contrast CO. 

In the first and third embodiments described above, the 
sense of contrast CO has been found as the distribution width 
of the histograms of the image data SO, the luminance data 
L* and the color data C*, while the standard deviation of the 
image data SO has been found as the sense of contrast CO in 
the second embodiment. However, regarding the image data SO, 
various kinds of information may be found as characteristic 
quantities making it possible to find the distribution widths 
and standard deviations of the histograms of the image data 
SO, the luminance data L* and the color data C* as well as 
the sense of contrast CO of the image data SO. The sense of 
contrast CO is then quantified by weighting and adding the 
characteristic quantities according to Equation (9) below: 

CO = ^ an ' vn < 9) 

where vn is the characteristic quantity, an is a weight, and 
n is the number of the characteristic quantities. The weight 
an may be found empirically. In other words, the sense of 
contrast CO is found while changing the weight, and visual 
evaluation is carried out on a plurality of images generated 
through different image processing in accordance with the 
sense Q f contrast CO. By selecting an image agreeing with 
the sense of contrast perceived visually, the weight an used 
at the time of generating the image is used for Equation (9) . 



In the first to third embodiments described above, the 
sense of contrast CO has been quantified- However, the type 
of contrast of the image may be found as the sense of contrast, 
as in the fourth and fifth embodiments. 

In the first to third embodiments, the type of contrast 
may be judged in accordance with a result of weighted addition 
of the characteristic quantities vn as shown in Equation (10) 
below, and the judgment result may be used as the sense of 
contrast CO : 

Ph = ^ hn. vn (for high-contrast image) 

n 

Ps ~ 2 sn * vn ( for standard-contrast image) (10) 

n 

PI = ^ In. vn (for low-contrast image) 

n 

Here, hn, sn, and In are weights for calculating Ph,Ps, and 
PI as indices representing probabilities of an image being 
a low-contrast image, a standard image and a high-contrast 
image, respectively. For example, if Ph, Ps , and Pi are 
respectively calculated to be 10%, 30%, and 70% for an image 
and 80%, 40%, and 5% for another image, the former is judged 
to be a low-contrast image and the latter is judged to be a 
high-contrast image. In this case, the sense of contrast CO 
is a signal having a number in accordance with the type of 
contrast, such as 1 for the low-contrast image, 2 for the 
high-contrast image and 3 for the standard image. Based on 
the type of contrast represented by the sense of contrast CO, 
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the tone conversion LUT is selected and the tone conversion 
processing is carried out on the image data SO. 

In the fourth embodiment above, the sense of contrast 
CO has been quantified based on the number n of the pixels 

5 in the light portion Ml obtained from the resolution data RL 
in the low frequency band and from the distribution width BM 
and BH of the histograms HM and HH of the resolution data RM 
and RH in the medium and high frequency bands. However, the 
number of pixels in the light portion, the distribution width 

0 of the histogram, or the standard deviation used in the third 
embodiment may be found as the characteristic quantities for 
the resolution data RL, RM, and RH in the low, medium, and 
high frequency bands so that the sense of contrast CO in each 
frequency band can be quantified by weighted addition of the 

5 characteristic quantities according to Equation (9). 
Furthermore, as shown by Equation (11) below, by weighted 
addition of the sense of contrast CO found for each of the 
frequency bands , the sense of contrast may be quantified . The 
characteristic quantities may include the number n of the 

0 pixels in the light portion Ml obtained from the luminance 
resolution data RLL in the low frequency band, the 
distribution widths of the luminance histograms RML and RHL 
in the medium and high frequency bands, and/or the 
distribution widths of the color histograms HMC and HHC of 

5 the color resolution data RMC and RHC in the medium and high 
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frequency bands in the high-chroma area M2 obtained from the 
color resolution data RLC in the low frequency band used in 
the fifth embodiment: 

CO = L <*i "li + M j3 j -mj + H -V yk-hk (11) 

* j 

5 where li, m j , hk are the characteristic quantities in each 
of the frequency bands, ax, (3 j , and y k are weights 
corresponding to an in Equation (9), L, M, and H are weights 
in each of the frequency bands, and i, j, and k are the numbers 
of the characteristic quantities in each of the frequency 
|io bands. The weights ax, j3 j , and y k and L, M 7 and K are found 
% empirically as the weight an in Equation (9) above. In 

Sj Equation (11), if L=l, M=0, and H=0, Equation (11) is 

* practically equivalent to Equation (9). 

ffl In this case, the image may be classified such as the 

Sil5 low-contrast image, the standard image, and the high-contrast 
M image, according to the value of the sense of contrast CO found 

by using Equation (9) or (11), and the classification result 
may be used as the sense of contrast CO. In this case, the 
sense of contrast CO is a value representing the low-contrast 
20 image, the standard image or the high-contrast image. 

In the fourth and fifth embodiments described above, 
the probability of the type of contrast may be found as in 
Equation (10) so that the type of contrast of an image can 
be found based on the probability. The judgment result is 
25 then used as the sense of contrast CO. 
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In the above embodiments , the processing means 2 carries 
out the tone conversion processing by changing the tone 
conversion LUT according to the sense of contrast CO and/or 
performing chroma conversion processing on the image data SO. 
However, the image processing is not limited to the processing 
above. For example, the sense of contrast CO is compared with 
a predetermined threshold value Thll and if C0<Thll, frequency 
processing for enhancing the sense of contrast, such as 
enhancement of a frequency component shown by a hatched 
portion in Figure 18 by using Equation (12) below may be 
carried out on the image data SO. In Figure 18, an Fx axis 
and an Fy axis represent frequencies in a Fourier Plane and 
the hatched portion corresponds to a high frequency component 
in the image data SO: 

F'(x, y) = F(x,y)+/? {F(x,y) - F (x,y ) -d ( CO ) } (12) 
where F(x,y) represents image data SO, F'(x,y) is the 
processed image data SI, d(CO) is a function for determining 
a degree of unsharpness, and/? is an enhancement coefficient. 

Furthermore, in the case where the image data SO 
represents an image including a human face, a face area 
corresponding to the face may be extracted from the image data 
SO so that AE processing (automatic exposure control 
processing) for changing the brightness of the face area is 
carried out according to the density of the face area and the 
sense of contrast CO having been quantified. In this manner, 
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the processed image data SI may be obtained. Hereinafter, 
processing means for carrying out the AE processing will be 
explained. Figure 19 is a block diagram showing an outline 
configuration of the processing means 2 for carrying out the 
- 5 AE processing. As shown in Figure 19 , the processing means 
2 comprises face extracting means 41 for extracting an area 
of a human face from the image represented by the image data 
SO, density calculating means 42 for finding a density tface 
of the face area extracted by the face extracting means 41, 
"510 and AE processing means 43 for obtaining the processed image 
y data SI by carrying out the AE processing on the image data 

ffl SO based on the sense of contrast CO and the density tface 

*P of the face area. 

y As a method of extracting the face by using the face 

["J 15 extracting means 41, the image may be divided based on a 
S distribution of hue and chroma of the image represented by 

the image data SO so that a face candidate area is extracted, 
and the face area is extracted from a shape of an area 
neighboring the face candidate area, as described in Japanese 
20 Unexamined Patent Publication No . 6 ( 1994 ) -67320 , for example. 

Alternatively, an ellipse circumscribing a simply-extracted 
face candidate area is found and the area surrounded by the 
ellipse may be used as the face area. Furthermore, the face 
area may be extracted by using a neural network described in 
25 Japanese Unexamined Patent Publication Nos . 5 ( 1993 ) -274438 
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and 5(1993)-307605, for example. 

The density calculating means 42 calculates an average 
of the pixel values in the face area extracted by the face 
extracting means 41 as the face area density tface, 
■ 5 When the AE processing is carried out, the sense of 

contrast CO input to the processing means 2 represents the 
distribution width of the histogram Hus quantified as in the 
first embodiment. 

The face extracting means 41 extracts the face area from 
JlO the image represented by the image data SO and the density 
y calculating means 42 calculates the density tface of the face 

03 area. The AE processing means 43 carries out the AE 

*F processing on the image data SO based on the sense of contrast 

!:f CO and the density tface of the face area . In the AE processing 

Hl5 means, after the AE processing is carried out on the entire 
S image data SO, further AE processing is then carried out only 

on the face area in order to change the density of the face 
adequately. Figure 20 is a diagram explaining the AE 
processing. In the AE processing means 43, the sense of 
20 contrast CO is compared with predetermined threshold values 
Thl2 and Thl4 <Thl2<Thl4). If C0<Thl2, the image is judged 
to be a low-contrast image and the density tface of the face 
area is compared with a predetermined threshold value Thl3. 
If tface < Thl3, the face is judged to be too dark and the 
25 AE processing is carried out on the image data SO so that the 
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density tface of the face area agrees with Thl3 as shown in 
Figure 20(a). In this manner, the processed image data SI 
are obtained. 

If C0<Thl2 and tface2^Thl3, the brightness of the face 
5 area is judged to be adequate and the AE processing is not 
carried out. 

If C0^Thl2 and tface < Thl3, the sense of contrast CO 
is judged to be adequate but the face area is judged to be 
too dark. Therefore, the processed image data SI are obtained 
0 by carrying out the AE processing on the image data SO in order 
to cause the density tface of the face area to become equal 
to (Thl3+tf ace) /2 ♦ 

If C0^Thl2 and tface^Thl3, the brightness of the face 
area is judged to be adequate and no AE processing is carried 
5 out . 

Meanwhile, if C0>Thl4, the image is judged to be a 
high-contrast image and the density tface of the face area 
is compared with a predetermined threshold value Thl5. If 
tface > Thl5, the face area is judged to be too bright and 

0 the AE processing for causing the density tface of the face 
area to agree with the threshold value Thl5 is carried out, 
as shown in Figure 20(b). In this manner, the processed image 
data SI are obtained. In this case, it is preferable for the 
AE processing to be carried out only on the face area. 

5 If C0>Thl4 and tface ^ Thl5, the brightness of the face 
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area is judged to be adequate and the AE processing is not 
carried out. 

If CO^ Thl4 and tface > Thl5, the sense of contrast CO 
is judged to be adequate but the face area is judged to be 
5 too bright. Therefore, the AE processing for causing the 
density tface of the face area to become equal to (Thl5 + 
tface) /2 is carried out on the image data SO. In this manner, 
the processed image data SI are obtained. 

If CO ^ Thl4 and tface ^ Thl5 , the brightness of the face 
0 area is judged to be adequate and no AE processing is carried 
out . 

In the third embodiment described above, if 0 <Thl5, the 
image is judged to be a flash image having a face area 
reflecting the light, and the AE processing for causing the 
5 density tface of the face area to become smaller may be carried 
out . 

In the embodiments described above , the processing means 
2 carries out the tone conversion processing, the chroma 
conversion processing, frequency enhancing processing or the 
0 AE processing . However, these kinds of processing may be used 
in combination, such as the tone conversion processing and 
the AE processing. Furthermore, various kinds of processing 
other than those described above may be used. 

Another embodiment of the present invention will be 
5 explained next. Figure 21 is a block diagram showing an 
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outline configuration of an image processing apparatus 
according to the embodiment. As shown in Figure 21, the image 
processing apparatus comprises conversion means 51 for 
converting the image data SO into the luminance data L* and 
the color data C* as the conversion means 15 in the second 
embodiment, multi-resolution conversion means 52 for 
obtaining the luminance resolution data RLL, RML, and RHL and 
the color resolution data RLC, RMC and RHC in the low, medium 
and high frequency bands by carrying out multi-resolution 
conversion on the luminance data L* and on the color data C*, 
histogram generating means 53 for generating the luminance 
histogram HLL of the luminance resolution data RLL in the low 
frequency band and the color histogram HLC of the color 
resolution data RLC in the low frequency band, pattern setting 
means 54 for setting a pattern J for image processing to be 
carried out on the image data SO based on the luminance 
histogram HLL and the color histogram HLC, processing means 
55 for obtaining the processed image data Si by carrying out 
image processing on the image data SO according to the pattern 
J having been set, and output means 5 6 for outputting the 
processed image data SI as a visible image. 

In the case where the color data C* can be obtained as 
chroma, the color histogram HLC in one dimension is generated. 
Meanwhile, the color histogram HLC in two dimensions as shown 
in Figure 10 is generated in the case where the color data 
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are obtained as a* and b*. 

In the processing pattern setting means 54 , the tone 
conversion LUT shown in Figure 6 and a value of the enhancement 
coefficient ac for improving the chroma C* are set as the 
- 5 processing pattern J. First, characteristic quantities 
representing the distributions of the luminance histogram HLL 
and the color histogram HLC are found from the histograms. 
The distribution width of the luminance histogram HLL is used 
as a characteristic quantity PI. If the color histogram HLC 
JlO is one-dimensional, the distribution width thereof is used 
hi as a characteristic quantity P2 while a distribution area of 

CO the color histogram HLC is used as P2 if the color histogram 

*S HLC is two-dimensional. The characteristic quantity P2 is 

y then compared with a predetermined threshold value Thl6. If 

rjl5 P2^Thl6, the tone conversion LUT3 is selected for the tone 
S conversion from the tone conversion LUTs shown in Figure 6, 

and the coefficient ac is set to 1.0. 

Meanwhile, if P2<Thl6, the characteristic quantity PI 
found from the luminance histogram HLL is compared with a 
20 predetermined threshold value Thl7. If Pl5^Thl7, the image 
is judged to be a high-contrast image. The LUTS is selected 
and ac is set to 1 . 0 . If PKThl7, the image is judged to be 
a low-contrast image, and the LUTl and ac=1.2 are set. 

The image processing is carried out by the processing 
25 means 55 according to the processing pattern J set in the above 
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manner. 

An operation of this embodiment will be explained next. 
Figure 22 is a flow chart showing the operation of this 
embodiment. In the conversion means 51, the image data SO 
are converted into the luminance data L* and the color data 
C* (Step Sll). In the multi-resolution conversion means 52, 
the luminance data L* and the color data C* are converted into 
multiple resolutions and the luminance resolution data RLL, 
RML , and RHL and the color resolution data RLC, RMC , and RHC 
in the low, medium, and high frequency bands are obtained (Step 
S12). In the histogram generating means 53, the luminance 
histogram HLL and the color histogram HLC are generated from 
the luminance resolution data RLL and the color resolution 
data RLC in the low frequency band (Step S13). 

The characteristic quantities PI and P2 of the luminance 
histogram HLL and the color histogram HLC are respectively 
calculated (Step S14), and whether or not P2 ^ Thl6 is 
satisfied is judged (Step S15). If the judgment result at 
Step S15 is confirmative, the tone conversion LUT3 is selected 
and the enhancement coefficient ac is set to 1.0 (Step S16) 
to set the processing pattern J. If the judgment result at 
Step S15 is negative, whether or not Pl^Thl7 is judged (Step 
S17) . If the judgment result at Step S17 is affirmative, the 

LUT5 is selected and the enhancement coefficient ac is set 
to 1.0 (Step S18) to set the processing pattern J. If the 
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judgment result at Step S17 is negative, the LUT1 is selected 

and the coefficient a c is set to 1.2 (Step S19). In this 
manner, the processing pattern J is set and the image 
processing is carried out on the image data SO according to 
5 the processing pattern J (Step S20) to obtain the processed 
image data SI. The processed image data SI obtained in the 
above manner are output as a visible image by the output means 
56 (Step S21 ) . 

In the above embodiment, the luminance data L* and the 
SLO color data C* are subjected to multi-resolution conversion 
hi and the histogram HLL of the resolution data RLL in the low 

CO frequency band and the histogram HLC of the color resolution 

HF data RLC in the low frequency band are generated. However, 

rff as shown in Figure 23, unsharp image generating means 57 for 

Hl5 generating the unsharp luminance image data Lus and the 
r« unsharp color image data Cus which are unsharp image data of 

the luminance data L* and the color data C* may be used instead 
of the multi-resolution conversion means 52 , and the luminance 
histogram HLus and the color histogram HCus may be generated 
20 from the unsharp luminance image data Lus and the unsharp color 
image data Cus respectively. 

In addition, all of the contents of Japanese Patent 
Application Nos. 1 1 { 1 999 ) -23 073 1 and 2000-173279 are 
incorporated into this specification by reference. 
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What is claimed is: 

1. An image processing method comprising the step of 
quantifying a sense of contrast of an image represented by 
image data, based on the image data. 

2. An image processing method as claimed in Claim 1, 
wherein the step of quantifying comprises the steps of: 

generating unsharp image data of the image data; 
generating a histogram of the unsharp image data; and 
quantifying the sense of contrast based on the 
histogram, 

3. An image processing method as claimed in Claim 1/ 
wherein the step of quantifying comprises the steps of: 

obtaining luminance data and color data representing 
luminance information and color information of the image from 

the image data; 

generating unsharp luminance image data and/or unsharp 
color image data which are unsharp image data of the luminance 
data and/or the color data; 

generating a luminance histogram and/or a color 
histogram which are histograms of the unsharp luminance image 
data and/or the unsharp color image data; and 

quantifying the sense of contrast based on the luminance 
histogram and/or the color histogram. 

4. An image processing method as claimed in Claim 3, 
wherein the step of generating the luminance histogram and/or 



the color histogram is the step of generating a color histogram 
representing a two-dimensional frequency distribution of the 
unsharp color image data in the case where the color image 
data are generated* 
5 5. An image processing method as claimed in Claim 1, 

wherein the step of quantifying comprises the steps of: 

generating unsharp image data of the image data; and 
quantifying the sense of contrast based on position 
information of a light portion and/or a dark portion in an 
0 unsharp image represented by the unsharp image data* 

6. An image processing method as claimed in Claim 1, 
wherein the step of quantifying comprises the steps of: 

obtaining multi-resolution image data in a plurality 
of frequency bands by converting the image data into multiple 
5 resolutions; 

generating a histogram of the multi-resolution image 
data in each of the frequency bands; and 

quantifying the sense of contrast based on the histogram 
in each of the frequency bands . 
0 7» An image processing method as claimed in Claim 1, 

wherein the step of quantifying comprises the steps of: 

obtaining luminance data and color data representing 
luminance information and color information of the image from 
the image data; 

5 obtaining multi-resolution luminance image data and/or 
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multi-resolution color image data in a plurality of frequency 
bands by converting the luminance data and/or the color data 
into multiple resolutions; 

generating a luminance histogram and/or a color 
histogram which are histograms of the multi-resolution 
luminance image data and/or the multi-resolution color image 
data in each of the frequency bands; and 

quantifying the sense of contrast based on the luminance 
histogram and/or the color histogram in each of the frequency 
bands . 

8. An image processing method as claimed in any one of 
Claims 1 to 7, further comprising the step of carrying out 
image processing on the image data based on the sense of 
contrast . 

9* An image processing method as claimed in Claim 8, 
wherein the image processing is at least one of tone conversion 
processing, frequency enhancing processing, AE processing 
and chroma conversion processing. 

10. An image processing method comprising the step of 
carrying out image processing for changing luminance 
information of an image represented by image data on the image 
data based on color information of the image. 

11. An image processing method as claimed in Claim 10, 
wherein the step of carrying out the image processing 
comprises the steps of: 



obtaining color data representing the color information 
from the image data; 

generating unsharp image data of the color data; 
generating a histogram of the unsharp image data; and 
- 5 carrying out the image processing on the image data based 

on the histogram. 

12. An image processing method as claimed in Claim 11, 
wherein the step of generating the histogram is the step of 
generating a histogram representing a two-dimensional 
yrilO frequency distribution of the unsharp image data, 
yj 13. An image processing method as claimed in Claim 10, 

yj wherein the step of carrying out the image processing 

^ comprises the steps of: 

obtaining color data representing the color information 
ljl5 from the image data; 

q obtaining multi-resolution image data in a plurality 

of frequency bands by converting the color data into multiple 
resolutions ; 

generating a histogram of multi-resolution image data 
2 0 in a lowermost frequency band out of the multi-resolution 
image data in the plurality of frequency bands; and 

carrying out the image processing on the image data based 
on the histogram. 

14. An image processing apparatus comprising 
25 contrast-sense quantification means for quantifying a sense 
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of contrast of an image represented by image data, based on 
the image data. 

15. An image processing apparatus as claimed in Claim 
14, wherein the contrast-sense quantification means 

5 comprises: 

unsharp image data generating means for generating 
unsharp image data of the image data; 

histogram generating means for generating a histogram 
of the unsharp image data; and 
0 quantification means for quantifying the sense of 

contrast based on the histogram. 

16. An image processing apparatus as claimed in Claim 
14, wherein the contrast-sense quantification means 
comprises : 

5 conversion means for obtaining luminance data and color 

data representing luminance information and color 
information of the image from the image data; 

unsharp image data generating means for generating 
unsharp luminance image data and/or unsharp color image data 

0 which are unsharp image data of the luminance data and/or the 
color data; 

histogram generating means for generating a luminance 
histogram and/or a color histogram which are histograms of 
the unsharp luminance image data and/or the unsharp color 
5 image data; and 
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quantification means for quantifying the sense of 
contrast based on the luminance histogram and/or the color 
histogram. 

17. An image processing apparatus as claimed in Claim 
5 16, wherein the histogram generating means generates a color 
histogram representing a two-dimensional frequency 
distribution of the unsharp color image data in the case where 
the unsharp image data generating means generates the unsharp 
color image data. 
0 18. An image processing method as claimed in Claim 14 , 

wherein the contrast-sense quantification means comprises: 
unsharp image data generating means for generating 
unsharp image data of the image data; and 

quantification means for quantifying the sense of 
5 contrast based on position information of a light portion 
and/or a dark portion in an unsharp image represented by the 
unsharp image data. 

19. An image processing apparatus as claimed in Claim 
14, wherein the contrast-sense quantification means 
0 comprises: 

multi-resolution conversion means for obtaining 
multi-resolution image data in a plurality of frequency bands 
by converting the image data into multiple resolutions; 

histogram generating means for generating a histogram 
5 of the multi-resolution image data in each of the frequency 
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bands; and 

quantification means for quantifying the sense of 
contrast based on the histogram. 

20, An image processing apparatus as claimed in Claim 
5 14, wherein the contrast-sense quantification means 

comprises : 

conversion means for obtaining luminance data and color 
data representing luminance information and color 
information of the image from the image data; 

0 multi-resolution conversion means for obtaining 

multi-resolution luminance image data and/or multi- 
resolution color image data in a plurality of frequency bands 
by converting the luminance data and/or the color data into 
multiple resolutions ; 

5 histogram generating means for generating a luminance 

histogram and/or a color histogram which are histograms of 
the multi-resolution luminance image data and/or the 
multi-resolution color image data in each of the frequency 
bands; and 

0 quantification means for quantifying the sense of 

contrast based on the luminance histogram and/or the color 
histogram in each of the frequency bands. 

21. An image processing apparatus as claimed in any one 
of Claims 14 to 20, further comprising processing means for 

5 carrying out the image processing on the image data based on 
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the sense of contrast. 

22. An image processing apparatus as claimed in Claim 
21, wherein the processing means carries out, as the image 
processing, at least one of tone conversion processing, 
frequency enhancing processing, AE processing and chroma 
conversion processing . 

23. An image processing apparatus which carries out 
image processing on image data for changing luminance 
information of an image represented by the image data, based 
on color information of the image. 

24. An image processing apparatus as claimed in Claim 

23, comprising: 

conversion means for obtaining color data representing 
the color information of the image from the image data; 

unsharp image generating means for generating unsharp 
image data of the color data; 

histogram generating means for generating a histogram 
of the unsharp image data; and 

processing means for carrying out the image processing 
on the image data based on the histogram. 

25. An image processing apparatus as claimed in Claim 

24, wherein the histogram generating means generates a 
histogram representing a two-dimensional frequency 
distribution of the unsharp image data. 

26. An image processing apparatus as claimed in Claim 
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23 , comprising: 

conversion means for obtaining color data representing 
the color information of the image from the image data; 

multi-resolution conversion means for obtaining 
multi-resolution image data in a plurality of frequency bands 
by converting the color data into multiple resolutions; 

histogram generating means for generating a histogram 
of multi-resolution image data in a lowermost frequency band 
out of the multi-resolution image data in the plurality of 
frequency bands; and 

processing means for carrying out the image processing 
on the image data based on the histogram. 

27. A computer-readable recording medium storing a 
program to cause a computer to execute an image processing 
method comprising the procedure of quantifying a sense of 
contrast of an image represented by image data, based on the 
image data. 

28 . A computer-readable recording medium as claimed in 
Claim 27, wherein the procedure of quantifying the sense of 
contrast comprises the procedures of: 

generating unsharp image data of the image data; 
generating a histogram of the unsharp image data; and 
quantifying the sense of contrast based on the 
histogram. 

29 . A computer-readable recording medium as claimed in 
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Claim 27, wherein the procedure of quantifying the sense of 
contrast comprises the procedures of: 

obtaining luminance data and color data representing 
luminance information and color information of the image from 
the image data; 

generating unsharp luminance image data and/or unsharp 
color image data which are unsharp image data of the luminance 
data and/or the color data; 

generating a luminance histogram and/or a color 
histogram which are histograms of the unsharp luminance image 
data and/or the unsharp color image data; and 

quantifying the sense of contrast based on the luminance 
histogram and/or the color histogram. 

30. A computer-readable recording medium as claimed in 
Claim 27, wherein the procedure of generating the luminance 
histogram and/or the color histogram is the step of generating 
a color histogram representing a two-dimensional frequency 
distribution of the unsharp image data in the case where the 
color image data are generated. 

31. A computer-readable recording medium as claimed in 
Claim 27, wherein the procedure of quantifying the sense of 
contrast comprises the procedures of: 

generating unsharp image data of the image data; and 
quantifying the sense of contrast based on position 
information of a light portion and/or a dark portion in an 
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unsharp image represented by the unsharp image data. 

32 . A computer-readable recording medium as claimed in 
Claim 27, wherein the procedure of quantifying the sense of 
contrast comprises the procedures of: 
- 5 obtaining multi-resolution image data in a plurality 

of frequency bands by converting the image data into multiple 
resolutions ; 

generating a histogram of the multi-resolution image 
data in each of the frequency bands; and 
JjlO quantifying the sense of contrast based on the histogram 

hj in each of the frequency bands. 

SB 33 . A computer-readable recording medium as claimed in 

*S Claim 27 , wherein the procedure of quantifying the sense of 

y contrast comprises the procedures of: 

H15 obtaining luminance data and color data representing 

Si luminance information and color information of the image from 

the image data; 

obtaining multi-resolution luminance image data and/or 
multi-resolution color image data in a plurality of frequency 
20 bands by converting the luminance data and/or the color data 
into multiple resolutions; 

generating a luminance histogram and/or a color 
histogram which are histograms of the multi-resolution 
luminance image data and/or the multi-resolution color image 
25 data in each of the frequency bands; and 
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quantifying the sense of contrast based on the luminance 
histogram and/or the color histogram in each of the frequency 
bands . 

34 . A computer-readable recording medium as claimed in 
any one of Claims 27 to 33, further comprising the procedure 
of carrying out image processing on the image data based on 
the sense of contrast, 

35 . A computer-readable recording medium as claimed in 
Claim 34, wherein the procedure of carrying out the image 
processing is the procedure of carrying out at least one of 
tone conversion processing, frequency enhancing processing, 
AE processing and chroma conversion processing. 

36. A computer-readable recording medium storing a 
program to cause a computer to execute an image processing 
method for carrying out image processing for changing 
luminance information of an image represented by image data 
on the image data, based on color information of the image, 

37 . A computer-readable recording medium as claimed in 
Claim 36, wherein the program comprises the procedures of: 

obtaining color data representing the color information 
from the image data; 

generating unsharp image data of the color data; 

generating a histogram of the unsharp image data; and 

carrying out the image processing on the image data based 
on the histogram. 
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38 • A computer-readable recording medium as claimed in 
Claim 37 , wherein the procedure of generating the histogram 
is the procedure of generating a histogram representing a 
two-dimensional frequency distribution of the unsharp image 
data , 

39 . A computer-readable recording medium as claimed in 
Claim 36, wherein the program comprises the procedures of: 

obtaining color data representing the color information 
from the image data; 

obtaining multi-resolution image data in a plurality 
of frequency bands by converting the color data into multiple 
resolutions ; 

generating a histogram of multi-resolution image data 
in a lowermost frequency band out of the multi-resolution 
image data in the plurality of frequency bands; and 

carrying out the image processing on the image data based 
on the histogram. 
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ABSTARCT OF THE DISCLOSURE 
The sense of contrast perceived by a viewer of an image 
is quantified and adequate image processing is carried out 
on image data based on the sense of contrast. Contrast-sense 
quantification means generates unsharp image data of the image 
data and then generates a histogram of the unsharp image data. 
Since the histogram of the image data includes lightness 
information of details of the image, a distribution width 
thereof does not represent the contrast perceived by the 
viewer of the image as a whole. However, since the histogram 
of the unsharp image data excludes information of the details, 
a distribution width of the unsharp image data represents the 
contrast of the overall image. The distribution width of the 
histogram of the unsharp image data is found as the sense of 
contrast and input to processing means. In the processing 
means, tone conversion processing is carried out on the image 
data by changing a tone conversion LUT based on the sense of 
contrast, and processed image data are obtained. 
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